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Abstract 

In this contribution we show that a suitably defined nonequilibrium entropy of an N-body isolated 
system is not a constant of the motion in general and its variation is bounded, the bounds deter- 
mined by the thermodynamic entropy ,i.e. , the equilibrium entropy. We define the nonequilib- 
rium entropy as a convex functional of the set of n-particle reduced distribution functions (n < N) 
generalizing the Gibbs fine-grained entropy formula. Additionally, as a consequence of our micro- 
scopic analysis we find that this nonequilibrium entropy behaves as a free entropic oscillator. In 
the approach to the equilibrium regime we find relaxation equations of the Fokker-Planck type, 
particularly for the one-particle distribution function. 
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I. INTRODUCTION 

It is a widely recognized fact that a general mathematical theoretical proof of the second 
law is still lacking. As stated in Ref. 1 and quoted here just for illustration sake "To the best 
of our knowledge no theoretical mathematical derivation of the second law has been given up 
until now; instead it has been based on Kelvin's or Clausius's principles of the impossibility 
of perpetual motion of the second kind 2 , which are based on experiment 3 ". This lack of 
definitive theoretical proof has lead to reports on the violation of the second law 4 or tests 
over its validity in some particular cases 5 , 6 . 
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The first significant contribution to the interpretation of the second law of Thermody- 
namics and the explanation of irreversibility goes back to Boltzmann. Nevertheless, it is 
known that Boltzmann's contribution was criticized by arguing that this contradicts the 
predictions based on the microscopic equations of motion. Later, Gibbs and P. Ehrenfest & 
T. Ehrenfest worked on this problem by introducing coarse-graining. However, those coarse- 
graining analyses require the introduction of a priori equal probability principles, which are 
hard to justify on physical grounds as was criticized by Einstein 7 . 

In this scenario, our contention is to discern the connection between the microscopic 
description of an isolated N-body system given through the classical Hamiltonian dynamics 
and the description at the macroscopic level expressed by the second law. 

It is known that for thermodynamic equilibrium the entropy can be given by the Gibbs 
formula 

Sn — —k B Tr (FlnF) , (1) 

where ks is the Boltzmann constant and F the full phase-space distribution function which 
we assume normalized to unity, i.e. Tr(F) = 1. However, this expression is not adequate for 
representing the entropy of nonequilibrium isolated systems for which no bath is present 8 . 
The reason is that although in the case of a time-dependent distribution function out of 
equilibrium, the entropy S given through (1) remains constant. This is not difficult to show 
given that F evolves according to the Liouville equation 

. (2) 

where [.., ..] p is the Poisson bracket. In fact, by using Eq. (2) the rate of change of the 
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entropy (1) is 




Tr ([H,F] p \nF) = -Tr (>[tf,lnF] p ) = -Tr {[H,F] p ) = . (3) 

Therefore here we will generalize the Gibbs's statistics to account for the entropy varia- 
tions in nonequilibrium systems. This constitutes an application of our previous results 9 . 
Our starting point is the description of the state of an isolated N-body system in terms 
of the set of n-particle reduced distribution functions in the framework of the BBGKY 
[Bogolyubov-Born-Green-Kirkwood-Yvon] description 10 . Unlike equilibrium, an overall pic- 
ture in terms of the full phase-space distribution function does not contain the amount of 
detail necessary to describe a nonequilibrium system. Nonequilibrium systems manifest a 
random clusterization which makes their distribution in the phase space unstable, thus there 
is a continuous process of creation of n-particle clusters at the expense of the annihilation 
of p-particle clusters with n ^ p. This fact is taken into account in the BBGKY hierarchy 
making this an appropriate framework for the description of nonequilibrium systems. In 
this context, since the collisions become explicit through the collision term in the equations 
of motion, the n-particle reduced distribution functions are not constant of the motion, 
therefore a way of defining the entropy to embody the approach to equilibrium might be ex- 
pressed in terms of this set of reduced distributions. This is what we do here: we propose a 
functional of the set of n-particle reduced distribution functions which generalizes the Gibbs 
entropy as the nonequilibrium entropy of the isolated N-body system. We will show that 
this entropy is not a constant of the motion and reaches its maximum value at equilibrium. 

In the next section, we introduce the Hamiltonian dynamics of the N-body system and 
obtain the generalized Liouville equation. In section 3, we define the nonequilibrium entropy 
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analyzing its properties. Section 4 is devoted to computing the entropy production and to 
the derivation of the kinetic equation for the one-particle reduced distribution function. In 
section 5 we describe the approach to equilibrium. Finally in section 6, we emphasize our 
main conclusions. 



II. HAMILTON! AN DYNAMICS 



Let us consider an N-body system with a Hamiltonian containing a kinetic energy term 
plus a two-particle interaction potential 



j=l &k=l 

with m being the mass of a particle, and 0(|qj — j ) = <f>j,k the interaction potential. 
Moreover, the equations of motion are 

dH dH 
dpi dcii 

As said in the introduction, the statistical description of the system can be performed in 
terms of the full phase-space distribution function F(x N ,t), where x N = {xi, xn} and 
Xj = (qj,pj) or alternatively in terms of the distribution vector 11 f. Both previous descrip- 
tions are completely equivalent, however the second one is more appropriate for nonequilib- 
rium systems. Here, 

f ={/ ,A (x 1 ),f 2 (x 2 ), Jn(x n )} (6) 

is the set of all the n-particle reduced distribution functions, with x n = {xi, x n }, n = 
0, ,N and where the n-particle reduced distribution functions 
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fn = J F(x N ,t) dx n+1 ...dx N , (7) 

are obtained by integrating over the N — n particles with f a — 1. The dynamics of the 
reduced distribution vector follows from the Liouville equation (2) by integration according 
to Eq. (7), thus one obtains 11 ' 12,13 



d n f d 

— f n = [H n , f n ] p + (N - n) J F jjn+1 —f n+1 dx n+1 , 



(8) 



where F j:Tl+1 = -V J>+ i0 J>+ iand 



i=l i^fc=l 

is the n-particle Hamiltonian. 

In a compact way and in the language of Hilbert spaces we can write Eq. (8) 11 ' 9 

i^m =cm (io) 

constituting the generalized Liouville equation which succinctly expresses the BBGKY hi- 
erarchy of equations. Here, £ is the generalized Liouvillian, a nonHermitian operator whose 
diagonal part VC is defined through 14,11 

(n\V£\ri) = i[H n , f n ] p 5 n > >n , n> , (11) 

where \n) represents the n-particle state. In addition, the nondiagonal part QC is given 
by 14,11 



(n\ QC \ri) =z|(iV-w)y^ J ¥ j)n+1 -^— f n+1 dx n+ i^ 5 n ',n+i , n > 1. (12) 

Here, V and Q, its complement with respect to the identity, are projector operators. From 
its definition through Eq. (11) one can see that VC is a (N + 1) x (N + 1) diagonal block 
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Hermitian matrix. On the other hand, from Eq. (12) it is possible to infer that QC is a 
nonHermitian (N + 1) x (JV + 1) diagonal block matrix with nonzero elements only along 
the diagonal (n, n + 1) with n > l 11 . In terms of the projectors just introduced, Eq. (10) 
can be rewritten 

ilm-V£f(t)=QCf(t). (13) 
Hence, the formal solution of Eq. (13) can be written as an integral equation 

f (f) = exp (-iVCt) f (0) + exp (iVCt) [ dr exp (-iVCr) (-iQ£)f (t) (14) 

Jo 

which can be formally solved to give 11 

f(t)=W(t,0)f(0) , (15) 



where the evolution operator U (t, 0) is given by a perturbative development as 

°° pt pt\ pt2 

/ dt x / dt 2 \ 
'o Jo Jo Jo 



U(t,0) = Y] / dt x \ dt 2 / dt 3 / dtjx 

n Jo JO JO JO 



3=0 

V(t,h) V(* J -_i,*j)exp(-iP£i J -) . (16) 

Here, V (tj-i, tj) = exp [iVC (tj-i — tj)] (—iQC) are nonHermitian propagators, tj < tj-i < 

< ti < t = t, and the integration proceeds from right to left. Differentiating Eq. (16) 

one find 

^U(t,0) = -iJCU(t,0) , (17) 

the evolution equation for U (t, 0). If now, we make a time-translation, and change the origin 

of the time scale so that the time series begin at time t 

r-o f t[ r t> 2 r tr 



U(0,-t)=^2 / dt 'i / dt 2 / dt> 3 / dt 'j 



X 



V(0,*i) V exp + , (18) 



00 fO fti rii ftj-i 

U(0,t) = Y^ / dt ^ / dt 2 / dt 3 / dtjx 

„_n Jt Jt Jt Jt 



with t\ — ti — t, (1 < I < j) and under time reversal 

j"=o 

V(0,ti) V(t i _i,f i )exp[-i?£(i i -t)} . (19) 

Interchanging the integration limits and the integrals we obtain after relabeling the dummy 
integration variables 15 

rti rt2 ftj-i 



W(0,t) = / d*i / dt 2 / * 3 / 

„_n ^0 ./0 ./0 JO 



dtjX 



3=0 

exp(-iP£t 1 )U(t i ,t i _i) U(ti,t) , (20) 

where now, U (tj, tj-i) = (— i<2£) exp [— iVC (tj — tj-i)]. In addition, by differentiating Eq. 
(20) one gets the evolution equation for U (0, t) 

^U(0,t)=U(0,t)ijC . (21) 

The propagator U (0, £) given through Eq. (19) propagates backwards in time from t to 
0, hence this must coincide with the inverse U(t,0)~ L of U{t,0) so that 

U (t,Q>y l f(t) = U(0,t)f(t) = f(0) . (22) 

It can be verified that U (0, i) is the inverse of U (t, 0) 15 . To begin, U (0, t) U (t, 0) = 1 for 
t — 0. Now by differentiating and taking into account Eqs. (17) and (21) we reach 

^W(0,f)W(f,0) = 0, (23) 

so U (0, t) U (t, 0) = 1 for all t. 

Since VC is Hermitian, all its eigenvalues are real 16 , which means that f(t) as given 
through Eqs. (15) and (16) will have an oscillatory behavior. 



III. NONEQUILIBRIUM ENTROPY 



Here as the nonequilibrium entropy for the N-body system we propose' 



S=-k B Tr{flnf- q 1 f} + S eq 

N 



9,14 



fn 
feq,r 



= -^b^ / fn^-^-dxi dx n + S eq , (24) 

n=l •* 



a convex functional of the distribution vector which generalizes the Gibbs formula . In 
Eq. (24), S eq is the thermodynamic entropy (i.e. the equilibrium entropy) and f eq is the 
equilibrium distribution vector satisfying £f eq = 0, the Yvon-Born- Green (YBG) equilibrium 
hierarchy 11 . Therefore, f eq is an eigenfunction of C with eigenvalue 0. Moreover, 

5S = -k B Ti {<Sf In (f-'f) } (25) 

is zero at equilibrium and 

fiS = ~k B Tr{5ft^6f} (26) 

is a negative quantity, which shows that S is maximum at equilibrium where its value is S eq . 

Note that the BBGKY scenario describes an interacting mixture of fluids made up of 
particle clusters in the phase space. Two such fluids differ in the size of the clusters they 
contain and each fluid contributes its own entropy, the n-particle entropy, to the total 
nonequilibrium entropy of our system. Likewise, the interaction between different fluids 
leads to the creation of n-particles clusters at the expense of the annihilation of p-particle 
clusters with p. 

More interestingly here the most important property of the entropy we propose is its 
direction of change in a natural process. To elucidate this, we must establish the entropy 
bounds, if any. Hence, let us define the n-particle entropies 

S n = ~k B ( / n lny^- dx 1 dx n . (27) 

J Jeq,n 
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Since the full distribution function F contains more information than f n , one might expect 
that S n > Sn- This can be proved from the convexity of the logarithmic function, In x < x— 1 
which can be rewritten 17 

f\nf-f\ng>f-g for / > 0, g > , (28) 

where there is strict inequality unless / = g. Hence, assuming that f — F and g = f n , from 
Eq. (28) one derives 



F\nFdx\....dxN > J F\n f n dx\....dxN = 

J f n \nf n dx 1 ....dx n . (29) 

Analogously, it can be proved 

//„l,/A...i I ,>// < h/„„ 4l ,J I „ (30) 

which allows us to rewrite Eq. (29) 

/Fh\Fdx\....dxN > / f n l n j— dxi dx n . (31) 
J Jeg,n 

Therefore, from Eqs. (1) and (27) 

S n > S N (32) 
and consequently, from Eqs. (24), (27) and (32) one obtains 

> S - S eq > S N . (33) 

In light of this, we find that S is bounded 

> S eq > S > S N + S eq . (34) 

This result together with our comments at the end of the previous section leads us to 
conclude that the nonequilibrium entropy S behaves as a free oscillator with an amplitude 
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of oscillation As = —Sn/2. Hence, there is no possibility of time arrow and a question arises 
as to how the equilibrium could be reached and more deeply how to re-read the second law 
for isolated systems. We will try to answer these questions in the next section. 

To end this section, in view of our previous conclusion we assume the existence of a 
potential associated to the harmonic entropic oscillator 

*(S) = lK eff (t) (S - S*) 2 , (35) 
with S* = S eq + -J*-. Therefore, the potential bounds satisfy 



$ (S eq ) = <S>(S N + S eq ) = l -K eff {t) (36) 



and the effective elastic constant is given through 

1 d 2 



K eff (t) 
Consequently, 



sot 2S 



(37) 



S - S* = A 5 sin (jK eff (t)t + ^ , 



(38) 



where f stands for the initial conditions. This system has a first integral of the motion its 
'energy' given by 18 

H( S{t ),S m ,t)=l(^§^j (39) 
which is constant. Moreover, the period of the oscillations r satisfies 

27T = Ty/K eff (T) (40) 

and should be coherent with the recurrence period of the Poincare cycles. 
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IV. ENTROPY PRODUCTION. THE LAW OF INCREASE OF ENTROPY 



The rate of change of the nonequilibrium entropy or entropy production is obtained by 
taking the time derivative of Eq. (24), giving 



as 

~dt 



-k B Tr In (f£f) } = ik B Tr {CUn (f£f) } . (41) 



In a more explicit way, after using Eqs. (8) (10)-(12), Eq. (41) can be rewritten 



as 

~dt 



1 N n p / o n \ 

~t E E / ^ -* flT 7sr ln + E F w + ^ 



(42) 



where J-j{x n ) is defined through f n (x n ) J 7 j(x n ) = f Fj jn+1 f n+1 dx n+ i, and T is the kinetic 

temperature taking into account that the dependence of f eq , n in the velocities is given through 

a local Maxwellian. The entropy production given in Eq. (42) vanishes at equilibrium and 

in any other case it should not be necessarily zero. In addition, because pj is arbitrary 

n f) 

+ (N-n) Jf = k B T— ln f eq , n (43) 

is sufficient to satisfy the extremum condition 5S/5f n \ eq = 0, with S = dS/dt. Precisely, 
Eq. (43) gives rise to the YBG hierarchy 9,19 . 

On the other hand, by using Eq. (43), we can rewrite the entropy production given 
through Eq. (42) as 



as ■ v ,; 

dt 



1 " " r 
~T E E ( N - ") / fnPi - ?7) ^ > 

71=1 1 = 1 



(44) 



which is the starting equation to analyze the relaxation to equilibrium. To this end, as in 
Nonequilibrium Thermodynamics 20 , from Eq. (44) we can establish the phenomenological 
relation 

n 

fnPi = fe q ,nPj ~ E -f & ~ Ft*) , (45) 
i=l 
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where L^j is a phenomenological matrix which in general might depend on the nonequilib- 

rium thermodynamic force (Ti — Tl q ). In terms of the mobility M^j = Lj ti /Tf n we can 
rewrite Eq. (45) as 

n 

= fnMj,* - n q ) , (46) 
i=i 

where we have defined the current Jj = f n pj — f eq ,nPj, so Jj and [Ti — J 7 ^ 9 ) constitute a 
pair of conjugated current and thermodynamic force, respectively . 

Now we are in position to introduce the crucial point that might explain the approach to 
equilibrium and the link with the macroscopic irreversibility. Thus, near equilibrium, which 
coincides with the extremum position of the entropic oscillator related to the potential given 
through Eq. (35), M^j — > which in this particular case should be a nonnegative 
constant matrix. Therefore, in this case 




constituting the law of increase of entropy. 

V. RELAXATION EQUATIONS 

In this section we will analyze the relaxation to equilibrium by deriving the relaxation 
equation for the one particle reduced distribution function. To obtain such an equation we 
introduce the inverse mobility matrix (X^=i CjjM^ = Sjj), the friction matrix which 
allows us to invert the near equilibrium version of Eq. (46) 

n n 

u {t % - n q ) = - E (S 3 > = - E S5p* (/« - • ( 48 ) 
i=i i=i 
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At this point it will be useful to introduce the physical volume of the system V as a scale 
factor, thus we will redefine the reduced distribution functions 13 . 

L = V n f n . (49) 

Additionally, we must also redefine the forces, writing TijV and Tl q ' /V instead of ^and 
T e { q . Hence, for n — 1, we obtain from Eq. (8) 

ai fl + p a^ f ' = {— Jap' 1 *- (50) 

Thus, by using Eqs. (43), (48) and (50) we obtain the kinetic equation for fi = f 

d d ( d \ d 

-{^v 1 )^-^ ' (51) 

where ( = C^i- m the thermodynamic limit 



d d ( d \ d 

m f+p d^ f ~ kBT W nfeq )^ 



-p(-^p(f-fe q ) , (52) 

with p = N/V being the density. This equation constitutes a generalization of the 
Bhatnagar-Gross-Krook (BGK) relaxation model 9 . 
To illustrate the approach to equilibrium let us write 

/(q,p,f) =V q (p,*)0(q,*) • (53) 

By introducing the factorization given through Eq. (53) into Eq. (52) after integration in p 
we obtain 

i + ^ = 0, (54) 



14 



where 

J<j> = <t> J ^qP^P (55) 

is the current of the probability density 0(q, t) or first moment of the density ip q , which 
satisfies the equation 

d d f ( d \ 

■7^J<fr + 7^0 J ^qPP^P + k B T ( — In / e J = pCJ^ . (56) 
Here, for time t 3> (pC)~\ Eq. (56) leads to 

j0 = pC ^q / ^ pprfp+ ^f~ (J^ ln /e ") ^ ' ( 5T ) 

which substituted into Eq. (54) and assuming that ip^ is a local Maxwellian such that 
/ V^qPP^P = - k B T, gives 

f = " W> , (58) 

where the lineal differential operator L q is given through 

k B T d ( d 1 J, \ 

L «*=-iK^W-W nf V ■ (59) 

This equation contains a term k B Td/dq\n f eq that plays the role of a thermal force usually 
introduced in polymer dynamics 21 . 

In the next section, starting in Eq. (58) and from the properties of L q defined through 
Eq. (59) we will study the approach to equilibrium. 

VI. APPROACH TO EQUILIBRIUM 

The differential operator L q introduced in the previous section is a nonHermitian operator 
whose Hermitian conjugated is defined through 

it k B T fd d \ d 
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Therefore, L q does not have an orthonormal base. However, we can define right-hand and 
left-hand eigenf unctions through 

Lq^p(q) = Apfip(q) (61) 

and 

l Vp(^) = V'pto) > ( 62 ) 
which we chose to be orthonormal, f dqQ p (q)u r (q) = 5 p>r . As has been said in section III, 
eg (q) is an eigenfunction with eigenvalue of the evolution operator L q , thus it is possible 
to write 

^p(q) = <MqH(q) » ( 63 ) 

which can be proved by direct substitution of this relation into Eq. (61) and taking into 
account Eqs. (59), (60) and (62). So, fio(q) = 0e 5 (q) and cj (q) = 1- On the other hand 
the eigenvalues different from zero are positive. In fact, by multiplying Eq. (61) by u p (q) 
and integrating, one obtains 

ksT f d d 

dq<f) eq —uj p —uj p > , (64) 



p( J dq dq 

where the right-had side in the last equality has been obtained by using Eq. (59) and 
integrating by parts. Also, the positivity of ( discussed in the context of Eq. (47) has been 
taken into account. 

Now any distribution 0(q, t) can by expanded in terms of the eigenf unctions 

0(q> t) = ^2 a p(O^(q)0e 9 (q) , (65) 
p 

where taking into account the orthonormality condition 

a p (t)= J dqu p (q)(f)(q,t) . (66) 
16 



From Eqs. (58), (59) and (65) one obtains the evolution equation for the coefficients of the 
expansion (65) 

^a p (t) = -X p a p (t) (67) 

which gives 

a p (t) = a p (0) exp(— \ p t) . (68) 
Since u Q = 1 and 0(q, t) should be normalized, a = 1. Therefore, 

0(q, t) = eg (q)+ M°) exp(-A p t)^ p (q)0 ey (q) (69) 

p 

showing that after a long period of time equilibrium is eventually reached. 
VII. CONCLUSIONS 

We find that the description of an N-body isolated system in the framework of the 
BBGKY hierarchy enables us to prove that the nonequilibrium entropy is not a constant 
of the motion. We emphasize that the nonequilibrium entropy should be defined as a con- 
vex functional of the distribution vector. Our contention is that the adequate functional 
is the one given in Eq. (24). Moreover, this description reconciles the reversibility of the 
Hamiltonian dynamics with the approach to equilibrium. 

Due to the periodic character of the solution of the microscopic equations given through 
Eqs. (15) and (16), we realize that the nonequilibrium entropy corresponds to a dynamical 
system that behaves as a free oscillator, an 'entropic oscillator' with well established bounds 
determined by the equilibrium entropy which is the maximum entropy. We have also manage 
to construct the Hamiltonian for this entropic oscillator. Hence, the approach to equilibrium 
occurs when the entropy production is positive, i.e., when the dynamical system is rising 
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through the walls of the elastic potential defined in Eq. (35). In other words, the entropy 
production is positive when the balance of forces appearing in the integrand of Eq. (42) is 
opposite to velocity thus preventing the expansion of the N-body system in the phase space. 
The natural extension of our theory to study non isolated systems, i.e. dissipative N-body 
systems, would be to consider a damped entropic oscillator instead a free oscillator. In the 
case of the damped entropic oscillator the system collapses in the equilibrium state which is 
the attractor of the dynamics. 

Performing a nonequilibrium thermodynamic analysis we are able to derive relaxation 
equations of the Fokker-Planck type, particularly for the one-particle distribution function. 
Finally, through an spectral analysis we show how these equations describe the approach to 
equilibrium. 
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